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he Center on Standards, Alignment, Instruction, and Learning (C-SAIL) examines 

how college- and career-readiness (CCR) standards are implemented, if they 

improve student learning, and what instructional tools measure and support their 

implementation. The Center studies elementary and high school math and English 
Language Arts (ELA) standards, and has a special focus on understanding implementation and 
effects of CCR standards for English Language Learners (ELLs) and students with disabilities 
(SWDs). Established in July 2015 and funded by the Institute of Education Sciences (IES) of 
the U.S. Department of Education, C-SAIL works closely with Kentucky, Massachusetts, Ohio, 
Texas, and California to explore their experiences with CCR standards-based reform. 


Data 


This analysis examines select questions from a spring 2016 survey administered to districts, 
principals, and teachers in the state of Ohio. We employed a stratified random sampling 
technique designed to ensure the sample was representative of districts in Ohio. Forty-two Ohio 
districts completed the survey. ' In every sampled elementary school, we sampled two fifth-grade 
math teachers, two fourth-grade ELA teachers, one SWD teacher, and one ELL teacher. In high 
schools, we sampled two ELA teachers and one teacher in each of the following specialties or 
subjects: SWD, ELL, algebra, algebra 2, and geometry. We chose the three math subjects because 
they are the most common college- and career-ready high school math courses, and so including 
them maximizes the number of high school target course responses we obtained. Further, we 
wanted to identify math classes enrolling students who were likely to be required to take the 
state mathematics assessment. We identified 49 districts”. Of those, 42 agreed to participate and 
completed the survey. This is a 85.7°% response rate. In total, 111 principals (or designated staff) 
out of the 185 eligible principals completed the principe survey in Ohio, for a response rate of 
60°%; and 417 out of 654 sampled teachers responded, for a response rate of 63.8%. 


1 Our system of releasing waves of districts into the sample, based on stratified probability sampling on critical 
parameters such as size and poverty, resulted in our ultimate sample being representative of districts in the state of 
Ohio. For technical details on our sampling method, see our Sampling Plan. 


2 There were 155 eligible districts released in Texas prior to the identification of 53 districts. 
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Content of the Report 


The results presented here focus on responses about the state’s standards-based reform policies as 
described by policy attributes (Porter, Floden, Freeman, Schmidt, & Schwille, 1988), the theoretical 
framework that undergirds C-SAIL’s research. ‘The framework posits that five attributes are 
related to successful policy implementation: 


M@ Specificity: How extensive, detailed, and/or prescriptive a policy is. The explicitness 
of the goals, guidelines, and resources may help schools implement policies with a 
greater degree of fidelity. When a policy has specificity, the education system provides 
clear guidance and support for teachers as they work to align their instruction to content 
standards. 


@ Authority: How policies gain legitimacy and status through persuasion (e.g., rules 
or law, historical practice, or charismatic leaders). Policies have authority when state 
and district leaders, parents, community members, and other stakeholders devote 
time and resources to the reform initiative, which sends the clear signal that the policy 
is an institutional priority. Policies are also deemed authoritative when stakeholders 
participate in the decision-making processes, or when they demonstrate their investment 
in the reform. When a standard has authority, teachers take it seriously and see it as a 
meaningful guide for instruction. 


M@ Consistency: [he extent to which policies are aligned and how policies relate to and 
support each other. When the policy system is characterized by consistency, key policy 
instruments such as standards and assessments align with each other. 


@ Power: How policies are reinforced and enacted through systems of rewards and 
sanctions. Policies that have power include incentives for compliance consistent with 
policy goals. 


@ Stability: The extent to which policies change or remain constant over time. When 
policies and reports, including curriculum materials and professional development, are 
stable over time, it reinforces teachers’ willingness to develop their capacity for teaching 
to standards. 


In this document, we present survey findings in three main sections—(1) the policy attributes; 
(2) challenges to implementing standards, resources respondents use to help them meet the 
challenges, and the resources that they report wanting more of in order to continue improving 
their implementation; and (3) the content of instruction. 


These analyses help us answer the following C-SAIL implementation research questions: (1) ‘To 
what extent 1s the policy system specific, consistent, authoritative, powerful, and stable, at the 
state, district, and school levels? (2) What is the nature and quality of support and guidance at the 
state, district, and school levels (e.g., challenges and resources)? and (3) How are teachers changing 
the content they cover, and how does this differ for ELA and math as well as for teachers of 
English Language Learners (ELLs) and of students with disabilities (SWDs), and for elementary 
and high school teachers? 
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To What Extent Is the Policy System Specific, Consistent, 
Authoritative, Powerful, and Stable, According to District 
Officials, Principals, and Teachers? 


We measured specificity with a series of questions that asked about the nature of guidance 
respondents receive on the amount, timing, and sequence of the content in the standards. 
Consistency reflects responses about the quality of alignment of key elements of the policy 
system (e.g., standards and assessments). Authority reflects questions about respondents’ buy-in 
and support for the standards. Power is defined as the number and type of rewards and sanctions 
respondents indicated were part of their standards policy system. Stability measures respondents’ 
views of how long aspects of a standards policy system will remain in place. 


As Figure | shows, responses for district officials, principals, and teachers all fall between 1.96 
and 3.03 where 4 is the highest possible response. ‘This reflects a moderate view of the strength of 
each of the attributes. 


Figure 1. Policy Attributes as Reported by District Officials, Principals, and Teachers 


Consistency: |=not at all 
aligned; 2=somewhat aligned; Consistency 
3=aligned; 4=strongly aligned 4 


Authority: 1=disagree strongly; 
2=disagree somewhat; 3=agree 
somewhat; 4=agree strongly; 
Respondents indicated their level 
of agreement with statements 
that reflected their level of 
support and buy-in for standards 
policies. 


Specificity Authority 


Power: 1=no rewards and 
sanctions; 2=some rewards and 
sanctions; 3=moderate rewards 
and sanctions; 4=strong rewards 
and sanctions 


Stability Power 


Stability: 1=1-2 years; 2=3 


YER 3=4 Yeats, a=oF Teas ——District —*—Principal ——Teacher 


Specificity: 1=disagree 

strongly; 2=disagree somewhat; 

3=agree somewhat; 4=agree strongly; Respondents indicated their level of agreement with statements 
asking about the level and type of guidance and supports they received related to their understanding and 
implementation of standards. 


Red circles indicate significance gaps between every respondent group. Blue circles indicate significance gaps 
between one group and the remaining two groups. Gray circles indicate significance gaps between only two 
groups (the highest and the lowest). 
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There are several statistically significant differences among respondent groups on how they rated 
the policy system on the five attributes. District officials thought standards policies were more 
specific than principals did; but district officials reported significantly /ess authority, power, and 
stability than did principals. Principals rated the policy system as significantly more specific, 
authoritative, and stable than did teachers. Teacher ratings of power were significantly higher 
than district officials’ ratings. 


In Figure 2, we compare math, ELA, ELL, and SWD teacher responses about the policy 
attributes. Scores in the 2.17 to 2.44 range for consistency and authority suggest the policy system 
could be strengthened in these areas. Scores between 2.39 and 2.47 for specificity warrant more 
investigation, to learn whether enough specificity is being provided to guide teachers’ use of the 
standards. With power scores averaging at 2.5, it might be asked whether rewards and sanctions 
could be employed more often or more effectively. Stability ranges widely from 2.39 to SWD 
teachers to 3.09 for ELL teachers, though all groups except ELLs fall below 2.5 (between 3 and 4 
years). 


Figure 2: Policy Attributes as Reported by Ohio Math, ELA, ELL, and SWD Teachers 
Consistency: 1|=not at all aligned; 


2=somewhat aligned; 3=aligned; 
A=strongly aligned 


Consistency 
4 


Authority: 1=disagree strongly; 

2=disagree somewhat; 3=agree 

somewhat; 4=agree strongly; 

Respondents indicated their level 

of agreement with statements that Specificity 
reflected their level of support and 

buy-in for standards policies. 


Power: ]=no rewards and sanctions; 
2=some rewards and sanctions; 
3=moderate rewards and sanctions; 
A=strong rewards and sanctions 


Stability: 1=1-2 years; 2=3 years; Stability Power 
3=4 years; 4=5+ years 


Specificity: 1=disagree strongly; 

2=disagree somewhat; 3=agree EA: Mall 5S WD EL. 
somewhat; 4=agree strongly; 

Respondents indicated their level of 

agreement with statements asking 

about the level and type of guidance and supports they received for related to their understanding and 
implementation of standards. 


Green circles indicate significance gaps between three different groups. Blue circles indicate significance gaps 
between one group and two other groups. 


4 | The Center on Standards, Alignment, Instruction, & Learning (C-SAIL) 


Figure 2 also shows that math teachers rated the policy system as significantly more authoritative 
but less consistent than ELA teachers did. SWD teachers rated the system as significantly more 
consistent than did math teachers, but less authoritative than did ELA teachers. ELL teachers 
rated the Ohio standards as significantly more stable than did ELA and SWD teachers. 


What Is the Nature and Quality of Support and Guidance 
at the State, District, and School Levels (Challenges and 
Resources)? 


In this section we show the challenges to standards implementation that our respondents 
reported. We then provide data on the five most useful resources respondents reported employing 
to help them respond to Ohio’s standards. Finally, we indicate which resources respondents 
reported they would like to have more of in their efforts to respond to Ohio’s new college- and 
career-ready standards. 


CHALLENGES TO IMPLEMENTING THE NEW CCR STANDARDS 


The survey presented a list of common challenges to implementing standards-based reform, 
related to students and parents, school organization, and policy. Respondents were asked to 
indicate whether each was “not a challenge,” “ a moderate challenge,” or 
“a major challenge.” Here we report the percent of respondents who indicated each to be a 
moderate or major challenge. Some challenges are applicable across all three respondents groups, 
while others apply more to school- or district-level administrators. Figure 3 lists the challenges we 
asked teachers about in the order of magnitude by which teachers reported them as challenges. 
This figure also shows principal and district official responses where we asked them about the 
same challenges. Figure 4 shows the challenges listed only on the principal and/or district 
surveys. 


99 66 


a minor challenge, 


The factors related to students and parents that districts and teachers most often indicate as 
moderate or major challenges are lack of support from parents, student absenteeism and 
tardiness, and a wide range of student abilities. Additionally, 57% of teachers felt that student 
preparation in prior grades was a problem, and 51% of district respondents chose “low student 
achievement” as a moderate or major barrier. 


The organizational factors most salient were related to the lack of ample time for reform-related 
activities. Districts and teachers indicated most frequently that insufficient class time was a 
challenge. And teachers and principals both indicated that “lack of teacher planning time 
built into the school day” was a major or moderate challenge. Similarly, 56°% of principals 
felt inadequate lead time to prepare before implementing a reform was a moderate or major 
challenge. 


There are several notable statistically significant differences in responses among district officials, 
principals, and teachers, which may reflect the salience of particular issues at different levels of 
the education system. Forty-one percent (41%) of principals compared to only 21% and 18%, 
respectively, of teachers and district officials, said that inadequate instructional resources were 
a moderate or major barrier. Another contrast is that 27% of principals noted teacher turnover 
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as a Challenge compared to only 5% of district officials. Principals were significantly more likely 
to say that lack of guidance for teaching the standards to SWDs and ELLs was a challenge, 
compared to teachers (48% of principals compared to 16% for teachers; and 34% for principals 
compared to 11% for teachers, respectively). 


Figure 3. Challenges to Implementing Standards as Reported by Teachers, Principals, and 
District Officials 


TEACHERS PRINCIPALS DISTRICT OFFICIALS 
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Language Learners 
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a MODERATE CHALLENGE ee MAJOR CHALLENGE QUESTION NOT ASKED TO GROUP 


Note: Overall teacher response varied from 405-407. A total of 70 SWD and 18 ELL teachers responded. 
108 to 109 principals responded and 40-42 district officials responded. 
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As shown in Figure 4, our district and principal respondents reported several challenges related 
to the nature of standards and assessment policy. Fifty-two percent (52%) of district respondents felt 
the “level of difficulty of the current standards” were a moderate challenge to implementing 
them, 81% indicated that conflicting state initiatives were a challenge, and 45% indicated that the 
amount of time used for additional district tests was a challenge to implementing standards. 


Figure 4. Challenges to Implementing Standards as Reported by Principals and District 
Officials 
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Useful Resources 


We provided a list of common resources used to guide and support standards implementation, 
and asked respondents to indicate whether they had access to the support, and whether they 
found it useful. Here we highlight the top five resources that our respondents indicated were 
provided to them and that they found useful for implementing standards. (Note: principals were 
asked separately about aligned resources for ELA and math, and we merged their responses 
across subjects, which is why only three resources are listed for principals; aligned curricula and 
assessments reflect responses pertaining to both ELA and math.) As Figure 5 shows, all three sets 
of respondents reported that curriculum aligned to CCR standards, and formative or diagnostic 
assessments aligned to CCR standards were rated in the top five most useful resources. Teachers 
and principals both named aligned textbooks in their top five useful resources. Teachers and 
districts included professional development related to CCR standards. ‘Teachers indicated that 
digital tools, such as online textbooks, webinars, videos, online communities, and applications 
were helpful resources that they used. Districts identified information about how to identify 

and implement effective curricula or instructional strategies and information about how CCR 
changes what is expected of teachers’ instructional strategies. 


Figure 5. Top 5 Useful Resources for Implementing Standards, as Reported by Teachers, 
Principals, and District Officials. 


Note: On the survey 
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teachers about 


math textbooks and & 
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Resources Desired by District Officials, Principals, and 
Teachers for Implementing the New CCR Standards 


The C-SAIL survey asked respondents to indicate which resources they wanted more of to 
improve their implementation of standards. Respondents indicated whether they wanted “less,” 
“the same,” or “more” of each resource. Figure 6 shows that most respondents want more of 
almost every resource listed on the survey. The exception is that only 37°% to 44% of respondents 
indicated they would like more textbooks aligned to CCR standards, but even this is more than 

a third of the sample. These results suggest that district officials, principals, and teachers alike 
desire more resources that offer them guidance on implementing the new standards—resources 
in the form of aligned curriculum, diagnostic assessments, digital tools, information about how 
CCR changes what students are to know and what teachers are to teach, and PD for principals 
and teachers. 


While the percentages of respondents who want more of these resources are generally high, it 
stands out that 82% of district officials said they want more information about how to implement 
strategies to address instructional needs of students with individualized education programs 
(IEPs). And nearly the entire sample, 92%, indicated they would like more information about 
how CCR standards change what is expected of teachers’ instructional practice. 


In terms of differences among respondents, districts reported wanting significantly more aligned 
formative and diagnostic tests than either principals or teachers (78° compared to 57% and 
56%, respectively). Districts reported wanting more information on how CCR standards change 
what students are expected to learn (74°% compared to 51% for principals and 49% for teachers). 
And districts (92%) were significantly more likely to report wanting information on how CCR 
standards change what is expected of teachers’ instructional practice, compared to principals 
(60%) and teachers (51°). 


How Are Teachers Changing the Content They Cover, and 
How Does This Differ for ELA and Math, For Teachers 

of English Language Learners (ELLs) and Students with 
Disabilities (SWDs), and for Elementary and High School 
Teachers? 


Our survey items on self-reported instruction asked a series of questions about the teacher’s 
amount of coverage of different English and math content, with content defined as the 
intersection of topic and cognitive demand (e.g., perform measurement conversions, where 
“perform” is the cognitive demand and “measurement conversions” is the topic). As a baseline 
measure, we asked teachers to report the extent to which they covered particular content in their 
math and ELA classes. 


C-SAIL content experts created the list of content items based on an analysis of each state’s 
standards, to identify a sample of content areas that the new standards emphasized, and those 
that were de-emphasized (see Appendix for the exact questions). The survey questions did not 


c-sail.org | 9 


Survey Analysis of Standards Implementation in OHIO 


Figure 6. Desired Resources as Reported by District Officials, Principals, and Teachers 
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Note: Resources are listed in order of magnitude as reported by teachers. 405-407 teachers responded, 108- 
109 principals responded, and 40-42 district officials responded. 
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indicate which items were emphasized or de-emphasized in the standards. Further, to reduce 
social desirability responses all items on the survey were chosen by C-SAIL content experts to 
include only appropriate content that appeared in the standards. 


Responses range from 2.51 to 3.76, where 2=minor coverage, 3=moderate coverage, and 
4=major coverage. 


Within-Teacher Analysis. Figure 7 shows the results of the content of instruction questions 
across elementary and high school math and ELA. Our analysis of ELA elementary school 
teacher survey responses indicates that general education and SWD teachers covered significantly 
more de-emphasized than emphasized content. ‘The difference in ELL teachers’ coverage of 
emphasized and de-emphasized content is not significant. For high school ELA, the opposite is 
true—ELA general education and SWD teachers report covering significantly more emphasized 
than de-emphasized ELA content. Again, ELL teachers’ differences in coverage of emphasized and 
de-emphasized content are not significant. 


For elementary school math, the trends are different. Elementary school general education 
math teachers and SWD math teachers report covering significantly more emphasized than de- 
emphasized content; the sample size for ELL teachers is too small to be included in the analysis. 
In high school math, general education teachers report covering more de-emphasized content than 
emphasized content. There are no significant differences in coverage of emphasized vs. de-emphasized 
content by SWD teachers, and the number of ELL teachers is too small to consider in this 
analysis. 


Across-Teacher Analysis. In elementary school ELA, general education teachers cover 
significantly more emphasized content than do elementary ELA teachers of SWDs. ‘The ELL 
sample is too small for this analysis. For de-emphasized content, none of the differences between 
groups are statistically significant. 


In high school ELA, there are no significant differences between teachers in either their coverage 
of emphasized content or coverage of de-emphasized content. 


In elementary school math, general education math teachers cover both emphasized and de- 
emphasized content significantly more than elementary school math teachers of SWDs. In high 
school math, there are no significant differences between teachers in their coverage of emphasized 
or de-emphasized content. 


Across-Subject Analysis. In elementary school, there are no significant differences in coverage 
of emphasized content between math and ELA. However, elementary general education ELA 
teachers cover significantly more de-emphasized content than elementary general education math 
teachers. And elementary ELA teachers of SWDs cover significantly more de-emphasized content 
than do elementary math teachers of SWDs. 


In high school, general education ELA teachers cover more emphasized content than general 
education math teachers, and high school ELA teachers of SWDs cover significantly more 
emphasized content than do high school math teachers of SWDs. There are no significant 
differences across subjects in high school for coverage of de-emphasized content. 
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Figure 7. Teachers’ Self-Reported Content Coverage in ELA and Math 
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Note: The survey question did not indicate which items were emphasized or de-emphasized in the standards. 
Further, to reduce social desirability responses, items on the survey were chosen by C-SAIL content experts to 
include only appropriate content that appeared in the standards. In ELA at the elementary level, 62 general 
education teachers, 19 SWD teachers, and 4 ELL teachers responded to the survey. In ELA at the high school 
level, 94 general education teachers, 20 SWD teachers, and 13 ELL teachers responded. In math at the 
elementary level, 69 general education teachers and 10 SWD teachers. In math at the high school level, 81 
general education teachers and 32 SWD teachers responded. Four exclusively elementary math ELL teachers 
answered the survey but were excluded from the analysis because of the insufficient sample size. 


Summary 


RQI1: To what extent is the policy system spectfic, consistent, authoritative, powerful, 
and stable, at the state, district, and school levels? 


There is clearly room for increasing the levels of consistency, authority, and stability. For 
specificity and power, the interpretation is more complicated, as a balanced and effective policy 
system may target moderate levels of specificity, to allow for more autonomy and decision making 
at local levels. Similarly, states may try to balance power (rewards and sanctions) with other 
mechanisms for compliance, such as authority. 


Statistically significant differences in how district officials, principals, and teachers view the 
policy system provide leverage points to discover where attributes are truly different by design 
(e.g, guidance to principals may be more specific than guidance to teachers), and where 
communication about policies could be improved (e.g., district rewards for teachers should be 
known and reported similarly across district and teachers). 
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RQ2: What ts the nature and quality of support and guidance at the state, district, and 
school levels (e.g., challenges and resources)? 


The three respondent groups identified key challenges to implementing standards. These 

data can be used to target support and guidance. For example, “students with a wide range of 
abilities” was cited frequently as a challenge. Districts might focus principal and teacher PD on 
strategies for instruction in classrooms with diverse students, and additionally explore alternative 
classroom organization. Similarly, some of the challenges identify potential leverage points for 
intervention, such as providing guidance to help navigate multiple state initiatives, or providing 
more information on how to address the standards with SWDs. 


Notable is that all three respondent groups found aligned curricula and assessments as the most 
useful resources for implementing the standards. Further, while respondents clearly indicated they 
found helpful and were using several key resources—aligned curricula, diagnostic assessments, 
textbooks, online tools, PD on the standards, and information about how to change instruction— 
these were the same resources they indicated that they wanted to have more of in order to 
improve their implementation. ‘This indicates that the resources currently provided are of 
considerable value to educators, so much so that educators believe they would benefit from even 
more of these types of supports. 


How are teachers changing the content they cover, and how does this differ for ELA and 
math, for teachers of English Language Learners (ELLs) and students with disabilities 
(SWDs), and for elementary and high school teachers? 


Some significant differences average .5 points on a | to 4 scale, and other differences reflect 
a range from “minor” coverage to approaching “major” coverage, both of which suggest the 
differences are educationally meaningful. 


We found that for elementary school ELA, both regular and SWD teachers cover significantly 
more of the content de-emphasized in the new standards, compared to the content emphasized in the 
new standards. If teachers’ instruction were well aligned to the new standards, we would expect 
the opposite of this to be true—teachers would be covering more of the emphasized content. 


We also investigated differences across ELA, math, and elementary and high school. We found 
that several types of teachers—ELA elementary general education and SWD teachers, and high 
school math—report spending more time on de-emphasized than emphasized content, while others— 
ELA high school general education and SWD teachers, and elementary math and SWD math 
teachers—report covering significantly more emphasized than de-emphasized content. 


These results warrant further investigation, to explore why certain groups of teachers seem to be 
more responsive to the new standards than others. 


NEXT STEPS 


This report of selected items from the C-SAIL survey offers insights into how respondents view 
their policy environment, the challenges they face, and the resources that help them address these 
challenges. They also set a baseline for investigating progress toward using the standards in the 
classroom. Later survey analyses will analyze how the policy attributes, resources, challenges, and 
instruction relate to student learning. 
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Appendix 


The following appendix details the survey questions applying to each scale in this report. 


CONSISTENCY 


District Survey Question 26 


(1—not at all aligned, 2—somewhat aligned, 3—aligned, 4-strongly aligned) 
Please indicate your opinion on the degree to which the following are aligned to the CCR 
standards: 
a ‘The state test 
District-mandated summative assessments 
Formative or diagnostic assessments selected or created by schools 
Formative or diagnostic assessments used district-wide 
Mathematics textbooks used in your school or district 
ELA textbooks used in your school or district 
Mathematics curriculum selected or developed by your district 


s>7 mMonunnode 


ELA curriculum selected or developed by your district 


Principal Survey Questions 20 and 21 
(1—not at all aligned, 2—somewhat aligned, 3—aligned, 4-strongly aligned) 


Question 20 
Please indicate your opinion on the degree to which the following are aligned to CCR standards 
for ELA: 
a The ELA section of the state test 
District-mandated summative assessments 
Formative or diagnostic assessments selected or created by your school 
Formative or diagnostic assessments used district-wide 
English/language arts textbooks used in your school 
English/language arts curriculum selected or developed by your district 
Professional development activities that you have participated in this year 


s>7 moandnsd 


The feedback I provide to teachers from their classroom observations 


Question 21 
Please indicate your opinion on the degree to which the following are aligned to CCR standards 
for mathematics: 

a ‘The math section of the state test 

b__ District-mandated summative assessments 


c Formative or diagnostic assessments selected or created by your school 
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Formative or diagnostic assessments used district-wide 

Mathematics textbooks used in your school 

Mathematics curriculum selected or developed by your district 
Professional development activities that you have participated in this year 
The feedback you provide to teachers from their classroom observations 


Teacher Survey Question 106 


(1—not at all aligned, 2—somewhat aligned, 3—aligned, 4-strongly aligned) 


Please indicate your opinion on the degree to which the following were aligned to the CCR 
standards for (ELA or math): 


mgmoaiawr.eD 


a 


ee 


The (ELA or math) sections of the test 

District-mandated summative assessments 

Formative or diagnostic assessments selected or created by schools 

Formative or diagnostic assessments used district-wide 

Textbooks used in your school 

Curriculum selected or developed by your district 

State-developed or organized professional development activities that you’ve participated 
in this year 

District-developed or organized professional development activities that you’ve 
participated in this year 

Administrator feedback provided to you from classroom observations (1.e., walkthroughs, 
formal observations, etc.) 


AUTHORITY 


District scales for authority were developed using survey questions 20, 21, 23 and 24. 


(1—not at all aligned, 2—somewhat aligned, 3—aligned, 4-strongly aligned) 


District Survey Questions 20, 21, 23 and 24 


Please indicate your agreement with the following statements: 


Question 20 


a 


b 


Qa 


CCR standards for ELA set appropriate expectations for student learning at each grade 
level. 

CCR standards for ELA positively affect the degree to which students are prepared for 
college and career. 

CCR standards for ELA make learning relevant to students’ everyday lives. 

Since [state] started implementing CCR standards for ELA, teachers in my district have 
made significant instructional shifts to tailor instruction to those standards. 

The ELA sections of the CCR standards test provide valuable information about how 
well students in my district are mastering the state standards. 

CCR standards for ELA are appropriate for ELLs. 

CCR standards for ELA are appropriate for students with disabilities’ learning (including 
those with mild learning disabilities but excluding those with severe or profound 
disabilities). 
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Question 21 


a 


b 


QO 


a oe 


Results from the ELA portion of the state test accurately represent students’ mastery of 
the ELA concepts emphasized in CCR standards for ELA. 

Results from the ELA portion of the state test are a good measure of how well students 
learned what ELA teachers in my district taught last year. 

CCR standards for ELA exclude important content that students should learn. 

CCR standards for ELA provide a manageable number of topics to teach in a school 
year. 

CCR standards for ELA give educators the flexibility they need to help students who are 
below grade level. 

CCR standards for ELA are more rigorous than the previous state standards. 

Teaching to CCR standards for ELA will increase student learning. 

Teaching to CCR standards for ELA 1s a major priority in my district. 


Question 23 


a 


b 


CCR standards for mathematics set appropriate expectations for student learning at each 
grade level. 

CCR standards for mathematics positively affect the degree to which students are 
prepared for college and career. 

CCR standards for mathematics positively affect how well students are prepared to 
compete in the workforce. 

CCR standards for mathematics make learning relevant to students’ everyday lives. 

Since [state] started implementing CCR standards for mathematics, teachers in my 
district have made significant instructional shifts to tailor instruction to those standards. 
The mathematics sections of the CCR standards test provide valuable information about 
how well students in my district are mastering the state standards. 

CCR standards for mathematics are appropriate for ELLs. 

CCR standards for mathematics are appropriate for students with disabilities’ learning 
(including those with mild learning disabilities but excluding those with severe or 
profound disabilities). 

Results from the mathematics portion of the state test accurately represent students’ 
mastery of the mathematics concepts emphasized in CCR standards for mathematics. 
Results from the mathematics portion of the state test are a good measure of how well 
students learned what mathematics teachers in my district taught last year. 


Question 24 


CCR standards for mathematics exclude important content that students should learn. 
CCR standards for mathematics provide a manageable number of topics to teach in a 
school year. 

CCR standards for mathematics give educators the flexibility they need to help students 
who are below grade level. 

CCR standards for mathematics are more rigorous than the previous state standards. 
Teaching to CCR standards for mathematics will increase student learning. 

Teaching to CCR standards for mathematics is a major priority in my district. 
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Principal scales for authority were developed using survey questions 6, 7, 8, and 9. 


(1—disagree strongly, 2—disagree somewhat, 5—agree somewhat, 4-agree strongly) 


Principal Survey Question 6 


Please indicate your agreement with the following statements: 


a 


College- and career-readiness (CCR standards) for ELA set appropriate expectations for 
student learning at each grade level. 

CCR standards for ELA make learning relevant to students’ everyday lives. 

Since [state] started implementing CCR standards for ELA, teachers in my district have 
made significant instructional shifts to tailor instruction to those standards. 

Results from the ELA portion of the state test provide valuable information about how 
well students in my school are mastering the state standards. 

I use results from the ELA portion of the state test to inform my school’s improvement 
planning. 

I use results from the ELA portion of the state test to inform teacher evaluations in my 
school. 

I use results from the ELA portion of the state test to inform professional learning 
decisions in my school. 

CCR standards for ELA are appropriate for English language learners. 

CCR standards for ELA set appropriate expectations for students with disabilities’ 
learning (including those with mild learning disabilities but excluding those with severe or 
profound disabilities). 


Principal Survey Question 7 


a 


b 


QO 


CCR standards for Mathematics set appropriate expectations for student learning at each 
grade level. 

CCR standards for Mathematics positively affect how well students are prepared to 
compete in the workforce. 

CCR standards for Mathematics make learning relevant to students’ everyday lives. 

Since [state] started implementing CCR standards for Mathematics, teachers in my 
school have made significant instructional shifts to tailor instruction to those standards. 
Results from the mathematics portion of the state test provide valuable information about 
how well students in my school are mastering CCR standards for Mathematics. 

I use results from the mathematics portion of the state test to inform my school’s 
improvement planning. 

I use results from the mathematics portion of the state test to inform teacher evaluations 
in my school. 

I use results from the mathematics portion of the state test to inform professional learning 
decisions in my school. 

CCR standards for Mathematics are appropriate for English language learners. 

CCR standards for Mathematics set appropriate expectations for students with 
disabilities’ learning (including those with mild learning disabilities but excluding those 
with severe or profound disabilities). 
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Principal Survey Question 8 


a (CCR standards for ELA exclude important content that students should learn. 

b CCR standards for ELA provide a manageable number of topics to teach in a school 
year. 

c CCR standards for ELA give educators the flexibility they need to help students who are 
below grade level. 

d CCR standards for ELA are more rigorous than the previous state standards. 


Principal Survey Question 9 


a CCR standards for Mathematics exclude important content that students should learn. 

b CCR standards for Mathematics provide a manageable number of topics to teach in a 
school year. 

c CCR standards for Mathematics give educators the flexibility they need to help students 
who are below grade level. 

d CCR standards for Mathematics are more rigorous than the previous state standards. 


Principal Survey Question 16 


a Ihave made teaching to CCR standards for ELA a major priority in my school. 
b My district has made teaching to CCR standards for ELA a major priority. 
c Mystate has made teaching to CCR standards for ELA a major priority. 


Principal Survey Question 17 


a Ihave made teaching to CCR standards for Mathematics a major priority in my school. 
b My district has made teaching to CCR standards for Mathematics a major priority. 
c Mystate has made teaching to CCR standards for Mathematics a major priority. 


Teacher scales for authority were developed using a composite of certain items in Questions 98, 
99 and 100, depending on which statements applied to their positions. All items are included 
below. 


Teacher Survey Questions 98, 99 and 100 


Please indicate your agreement with the following statements: 

a CCR standards for (ELA or math) positively affect the degree to which students are 
prepared for middle school. 
CCR standards for (ELA or math) make learning relevant to everyday lives. 

c Since starting to implement for CCR standards for (ELA or math), I have made 
instructional shifts to ensure students meet those standards. 

d_ Students’ results from the (ELA or math) section provide valuable information about how 
well my students are mastering CCR standards for (ELA or math). 

e CCR standards for (ELA or math) exclude important content that students should learn. 

f CCR standards for (ELA or math) provide a manageable number of topics to teach in a 
school year, for my grade level. 

eg CCR standards for (ELA or math) give educators the flexibility they need to help students 
who are below grade level. 

h CCR standards for (ELA or math) are more rigorous than previous state standards. 
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k 
1 


Students’ results from the (ELA or math) sections of the state test are useful for improving 
my practice. 

CCR standards for (ELA or math) set appropriate expectations for ELL. 

CCR standards for (ELA or math) set appropriate expectations for SWD. 

CCR standards for (ELA or math) set appropriate expectation for students learning at 
each grade level. 


m_ I plan lessons with CCR standards for (ELA or math) in mind. 


POWER 


District Survey Question 16 


(1—not at all, 2—small extent, 3—moderate extent, 4—large extent) 


Please indicate your level of agreement with the following statements: 


a 


b 


Cc 


d 


e€ 


f 


The district rewards or recognizes principals based on their schools’ implementation of 
CCR standards. 

The district rewards or recognizes teachers based on their schools’ implementation of 
CCR standards. 

There are negative repercussions for principals in my district if their schools poorly 
implement. 

There are negative repercussions for teachers in my district if their schools poorly 
implement. 

The district rewards or recognizes principals based on their schools scores. 

The district rewards or recognizes teachers based on their students scores. 


Principal Survey Question 19 


(1—-disagree strongly, 2—disagree somewhat, 5—agree somewhat, 4—agree strongly) 


Please indicate your level of agreement with the following statements: 


a 


b 


District leaders publicly reward or recognize principals in this district for exemplary 
leadership practices aimed at implementing CCR standards. 

District leaders publicly reward or recognize principals in this district for exemplary 
student achievement gains. 

There are negative repercussions for me if students in my school do not perform well on 
the state test. 


Teacher Question 102 


(1—disagree strongly, 2—disagree somewhat, 5—agree somewhat, 4-agree strongly) 


Please indicate your level of agreement with the following statements: 


a 


b 


Teachers who poorly implement CCR standards for (math or ELA) will have a lower 
summative evaluation rating. 

There are negative repercussions for teachers at this school whose students performed 
poorly on the state test. 

Teachers at this school are recognized for using exemplary classroom practices that 
support the implementation of CCR standards for (math or ELA). 

Teachers at this school are recognized for their students’ achievement gains on the state 
test. 
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STABILITY 


One question from each group was used to establish the stability scale. 


(1=1-2 years, 2= 3 years, 3=4 years, 4=5+ years) 


District Survey Question 19 


Including this current school year, how long do you believe each of the following will remain in 
effect? 

a CCR standards for ELA 

b CCR standards for Math 

c The state test 


Principal Survey Question 22 


Including this current school year, how long do you believe each of the following will remain in 
effect? 

a CCR standards for ELA 

b CCR standards for Math 

c ‘The state test 


Teacher Survey Question 107 


Including this current school year, how long do you believe each of the following will remain in 
effect? 

a CCR standards for (ELA or math) 

b The (ELA or math) section of state test 

c ‘The current proficiency standards (i.e. cut scores) for the state test. 


SPECIFICITY 


The district scale for specificity was created using the average of questions 22 and 25. Only one 
question was used for the principal and teacher scales. 


(1—-disagree strongly, 2—disagree somewhat, 5—agree somewhat, 4—agree strongly) 


District Survey Question 22 


Please indicate your level of agreement with the following statements: 
a CCR standards for ELA clearly indicate the content teachers should teach. 
b Teachers have received guidance from my district that clearly indicates the order in which 
they should teach each content area in CCR standards for ELA. 
c ‘Teachers have received guidance from my district that clearly indicates how much time 
they should spend on each content area in CCR standards for ELA. 


District Survey Question 25 


Please indicate your level of agreement with the following statements: 
a CCR standards for math clearly indicate the content teachers should teach. 
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Teachers have received guidance from my district that clearly indicates the order in which 
they should teach each content area in CCR standards for math. 

Teachers have received guidance from my district that clearly indicates how much time 
they should spend on each content area in CCR standards for math. 


Principal Survey Question 18 


Please indicate your level of agreement with the following statements: 


a 


b 


d 


My teachers have received specific guidance from my district on the order in which they 
should teach content area in CCR standards for ELA. 

My teachers have received specific guidance from my district on how much time they 
should spend on each content area in CCR standards for ELA. 

My district has provided teachers in my school with lesson plans aligned with CCR 
standards for ELA. 

My teachers have received specific guidance from my district on the order in which they 
should teach content area in CCR standards for Mathematics. 

My teachers have received specific guidance from my district on how much time they 
should spend on each content area in CCR standards for Mathematics. 

My district has provided teachers in my school with lesson plans aligned with CCR 
standards for Mathematics. 


Teacher Survey Question 101 


Please indicate your level of agreement with the following statements: 


a CCR standards for (ELA or math) clearly indicate the content I should teach. 
b- [have received guidance from my district that clearly indicates the order in which I 
should teach each content area for CCR standards in (math or ELA). 
c ‘Teachers have received guidance from my district that clearly indicates how much time I 
should spend on each content area for CCR standards in (math or ELA), 
CHALLENGES 


(1-not a challenge, 2—minor challenge, 5—moderate challenge, 4—major challenge) 


Districts 


To what extent is each of the following a challenge to your district’s efforts to implement CCR 
standards in your district? 


SSB St ge Fa -O “Gy 0 of 8 


Lack of support from parents 

Student absent and tardy 

Insufficient class time 

Wide range of student abilities 

Large class size 

Inadequate instructional resource 

Principal turnover 

Teacher turnover 

Lack of school resources to provide extra help for students 
Level of difficulty of the current standards 
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avto 8B Br 


Conflicting state initiatives 

Conflicting district initiatives 

Insufficient understanding by teachers 

Insufficient understanding by principals 

Lack of high-quality teaching 

Low student achievement 

Amount of time used for additional district-administered tests 


Principals 


To what extent is each of the following a challenge to your district’s efforts to implement CCR 
standards for ELA and mathematics? 


a ‘Teacher turnover 

b Inadequate school resources 

c Inadequate lead time to prepare before implementing reform 

d_ Lack of teacher planning time built into the school day 

e Frequent changes in district policy and priorities 

f Frequent changes in district leadership (e.g., the superintendent) 

g Lack of high-quality professional development opportunities for teachers 

h_ Lack of high-quality professional development opportunities for principals 

i Lack of guidance for teaching grade-level standards to students with disabilities 

j Lack of guidance for teaching grade-level standards for English Language Learners 
Teachers 


Thinking of your target class, to what extent is each of the following a challenge to your district’s 
efforts to implement CCR standards for (ELA or math)? 


TRO oe Ho Ao oe 


Inadequate student preparation in prior grades 

Lack of support from parents 

Student absenteeism and tardiness 

Insufficient class time to cover all the content 

Wide range of student abilities to address 

Large class size 

Inadequate instructional resources (e.g., textbooks) 

Frequent changes in school priorities or leadership (e.g. principal turnover) 
Lack of school resources to provide extra help for students 

Lack of planning time built into the school day 

Lack of guidance for teaching grade-level standards to students with disabilities 
Lack of guidance for teaching grade-level standards for ELLs 


RESOURCES 


(1—less, 2—same amount, 5—more) 


Districts 


How much of each of the following resources would you like in the future, compared to what you 
use now? 
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Textbooks aligned to CCR standards 

Curriculum resources aligned to CCR standards 

Formative or diagnostic assessments aligned to CCR standards 

Digital tools 

Information about how CCR standards changes what students are expected to learn 
Information about how CCR standards changes what is expected of teachers’ 
instructional practice 

PD for principals on CCR standards 

PD for teachers on CCR standards 

Clarification on how instruction is expected to shift in order to align to CCR standards 
Information about how to identify and implement effective curricula or instructional 
strategies 

Information about how to implement strategies to address the instructional needs of 
English language learners 

Information about how to implement strategies to address the instructional needs of 
students with individualized education programs (IEPs) 


Principals 


How much of each of the following resources would you like in the future, compared to what you 


use now? 
a ‘Textbooks aligned to CCR standards for ELA 
b Curriculum resources aligned to CCR standards or ELA 
c Formative or diagnostic assessments aligned to CCR standards for ELA 
d_ Digital tools (e.g., online textbooks, webinars, videos, online communities, applications) 
e Information about how CCR standards for ELA change what students are expected to 


— 


p 


learn 

Information about how CCR standards for ELA change what is expected of our teachers’ 
instructional practice 

Professional development on CCR standards for ELA 

Other (specify) 

Textbooks aligned to CCR standards for Mathematics 

Curriculum resources aligned to CCR standards for Mathematics 

Formative or diagnostic assessments aligned to CCR standards for Mathematics 

Digital tools (e.g., online textbooks, webinars, videos, online communities, applications) 
Information about how CCR standards for Mathematics change what students are 
expected to learn 

Information about how CCR standards for Mathematics change what is expected of our 
teachers’ instructional practice 

Professional development on CCR standards for Mathematics 


Other (specify) 


Teachers 


How much of each of the following resources would you like in the future, compared to what you 


use now? 


a 


b 


Textbooks aligned to CCR standards 
Curriculum resources aligned to CCR standards 
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Formative or diagnostic assessments aligned to CCR standards 

Digital tools 

Information about how CCR standards changes what students are expected to learn 
Information about how CCR standards changes what is expected of teachers’ 
instructional practice 

Professional development on CCR standards 


Other (specify) 


moana 


a 79 


Instructional Practices 


Below are the groupings of instructional practices that are either CCR emphasized or CCR de- 
emphasized. Teachers responded based on their subgroup. 


Thinking about your target class, please indicate the level of emphasis you currently give to each 
of the following in your instruction in your target class. 


(1—none, 2—minor emphasis, 3—moderate emphasis, 4—major emphasis) 


In the survey, the following practices were grouped together as CCR-emphasized for elementary 
school ELA: 


Apply grammatical rules 

Compare multiple texts on the same theme 

Demonstrate ability to write different forms of text 

Engage in effective conversation and discussion with peers 

Identify correct meaning within context for words with multiple meanings 


oe oN 


The following practices were grouped together as CCR de-emphasized for elementary school 
ELA: 

Apply cognitive strategies when reading 

Demonstrate correct spelling rules 

Identify main, key and supporting ideas, and details 

Interpret words and phrases with multiple meanings 

Locate and use textual evidence to support comprehension 


oe wonr 


CCR-emphasized practices for high school ELA: 
1 Analyze vocabulary choices in different forms of text (e.g., use of technical or figurative 
language as appropriate) 
Apply rules for capitalization and punctuation 
Identify similar themes in multiple texts 
Demonstrate ability to write for different purposes 
Demonstrate speaking and listening skills in different engagements with peers (e.g., 
conversations, discussions, debates) 


Or OO NO 
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CCR 
1 


2 
4 
5 


de-emphasized practices for high school ELA: 
Identify rhyme scheme in a poem 
Demonstrate correct grammar rules 
Discuss the characteristics of different genres of text 
Locate and use textual evidence to support comprehension 
Vary sentence construction in writing 


CCR-emphasized practices for elementary math: 


R 
l 
2 
° 
4 
a 
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CCR- 


R 
l 
2 
3 
4 
2 


Demonstrate understanding of angle measurement 
Demonstrate understanding of fraction multiplication 
Perform the procedures of adding and subtracting fractions 
Represent fractions 

Solve one-step equations 


de-emphasized practices for elementary math: 
Calculate simple probabilities 
Demonstrate understanding of data in tables or graphs 
Demonstrate understanding of geometric or arithmetic patterns 
Demonstrate understanding of rate of change/slope 
Perform measurement conversions 


emphasized practices for algebra: 
Apply linear and non-linear functions to real-world settings 
Convert expressions involving radicals to expressions with rational exponents 
Demonstrate understanding of exponential functions 
Demonstrate understanding of sequences 
Interpret the slope in real-world settings 


CCR de-emphasized practices for algebra: 


CCR- 


R 
l 
2 
2 
4 
a 


Compute with exponents and radicals (e.g., square roots) 
Demonstrate understanding of estimation 

Find the factors of an algebraic expression 

Perform operations on polynomials 

Perform procedures involving rate of change/slope 


emphasized practices for algebra 2: 
Perform procedures with complex numbers 
Demonstrate understanding of linear functions 
Apply functions to real world settings 
Demonstrate understanding of polynomials 
Demonstrate understanding of inequalities 
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CCR de-emphasized practices for algebra 2: 


l 


Or ® OO NO 


Solve systems of equations 

Memorize the symbolic representation for a linear function 
Perform procedures on polynomials 

Perform operations on exponential expressions 

Memorize attributes of exponential functions 


CCR-emphasized practices for geometry: 


l 


He OO 


Demonstrate understanding of rigid transformations (e.g., slides/translations, flips/ 
reflections, turns/rotations) 

Use geometry to model situations (e.g., use circles, three-dimensional objects to model 
real-world situations) 

Demonstrate understanding of similarity 

Justify properties of circles 

Generalize transformations to other concepts (e.g., congruence) 


CCR de-emphasized practices for geometry: 


l 


Or OOF hO 


Perform procedures associated with triangles 

Memorize definitions and formulas associated with triangles 
Perform procedures to determine angle measures 

Memorize definitions and formulas associated with quadrilaterals 
Perform procedures associated with circles 
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